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DESCRIPTION 

Motion compensated reconstruction technique 

The present invention relates to the field of digital imaging. La particular, the present invention 
relates to a motion compensated image reconstruction from projections as in positron emission 
5 tomography (PET), single photon emission computed tomography (SPECT) and computed 
tomography (CT). More specifically, the present invention relates to a method of 
reconstructing an image from emission or transmission data of an object, to an image 
processing device for reconstructing an image from emission or transmission data, to a PET, 
SPECT, or CT system and to a computer program product 

10 

In medical imaging techniques known as emission computer tomography, images of an object 
are created based on the detection of gamma rays emitted from the object The g amm a rays 
may be emitted from a tracer accumulated in the object Such a tracer may, for example, be 
based on 18 F-fluorordeoxyglucose. In positron emission tomography (PET), positron-electro 

15 annihilations within the object to be imaged cause gamma rays to be emitted in pairs of two 
gamma photons, which fly in (almost) exactly opposite directions. The path formed by each 
pair of gamma photons represents a line, which is sometimes referred to as a 'Tine of 
response". The specific distribution of the positron emitting contrast agent or tracer within the 
object can be determined by calculating the positions of these lines of coincidence. The 

20 aggregate of such information can be used to reconstruct an image. 

Energy carried by the gamma photons is typically sensed by detectors disposed in an array 
around the object under study. The detectors convert the energy carried by the gamma 
photons, to record the position of the event which gave rise to the rays. Electrical signals 
25 representative of the detected gamma photons may be processed by a system, which typically 
includes a programmed digital computer capable of processing the position data to form an 
image of the structure, organ or patient under examination. It is the aim of PET- imaging to 
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reconstruct the distribution of the contrast agent or tracer within the human body or object 
This distribution is called emission image and is reconstructed from the emission measurement 
or emission data acquired as described above. 

The period of time necessary for such measurements depends upon the half-time of the tracer 
or agent used as well as on the maximum count rate that the system can handle and is 
occasionally ten minutes to 45 minutes. Conventionally, the object needed to be fixed both in 
position and direction during the measurement period. Such stationary posture may be very 
painful to a human body or an animal. Also, the significantly long scan time leads to significant 
losses of resolution due to patient or organ motion, in particular for heart and thorax imaging 
where heart and breathing motion is present during the data acquisition. Also, artifacts due to 
a motion or deformation of the object of interest appear in the image obtained by image 
reconstruction. In known techniques, only data which belong to a certain phase of the motion 
are used for reconstruction. This results in less artifacts and sharper images, but the signal-to- 
noise-ratio is significantly reduced because some data are no longer used for reconstruction. 

It is an object of the present invention to provide for an improved image reconstruction. 

According to an aspect of the present invention, the above object may be solved by a method 
according to claim 1 for reconstructing an image from measured time integrals of an object 
According to this exemplary embodiment of the present invention, the measured line-integrals 
are binned into a plurality of temporal bins, a plurality of motion fields is determined for the 
plurality of temporal bins and first data are selected from a selected bin of the plurality of 
temporal bins. Then, an intermediate image is forward-projected for forming second data by 
using a motion field of the plurality of motion fields that belongs to the selected temporal bin. 
Then, a difference between the first data and the second data is determined and the 
intermediate image is up-dated on the basis of the difference. 
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Advantageously, the above method takes a motion and deformation of the object of interest 
into account Furthermore, it may still allow to maximize a likelihood function. Overall, 
according to this exemplary embodiment of the present invention, even in the presence of 
motion or deformation in the object of interest, a proper reconstruction may be realized, 
5 yielding a sharp image with high signal-to- noise-ratio. 

Claims 2 to 6 provide for further advantageous embodiments of the present invention. 

Another exemplary embodiment of die present invention as set forth in claim 7 provides for an 
10 image processing device for reconstructing an image from measured line integrals, which, e.g. 
during the reconstruction of a PET image, takes into account a motion and/or deformation of 
the object of interest 

Another exemplary embodiment of the present invention as set forth in claim 8 provides for a 
15 positron emission tomography system, which may include a scanner system such as the one, 
for example, depicted in US 5,703,369, which is hereby incorporated by reference, which 
allows for sharp PET images, even in the case of a moving, and/or deforming object of 
interest 

20 According to another exemplary embodiment of the present invention as set forth in claim 9, a 
computer program product comprising a computer program is provided, causing a processor 
to perform an operation when the computer program is executed on the processor, 
corresponding to the method according to the present invention. The computer program may 
be written in any suitable programming language, for example, in C++ . The computer 

25 program product may be stored on a computer readable medium such as a CD-ROM. Also, 
these computer programs may be available from a network, such as the WorldWideWeb, 
from which they may be downloaded into image processing units or processors, or any 
suitable computers. 
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It may be seen as the gist of an exemplary embodiment of the present invention that a motion 
compensated iterative reconstruction technique for reconstructing an image from measured line 
integrals is provided, taking a motion and/or deformation of the object of interest into account 
In particular, according to an aspect of the present invention, the forward projection of the 
5 iterative reconstruction technique is performed on the basis of a motion field describing at least 
one of a motion or deformation of the object with respect to a reference grid of the 
intermediate image. 

These and other aspects of the present invention will become apparent from and will be 
10 elucidated with reference to the embodiments described hereinafter. 

Exemplary embodiments of the present invention will be described in the following, with 
reference to the following drawings: 

15 Fig. 1 shows a schematic representation of an image processing device according to an 
exemplary embodiment of the present invention, adapted to execute an exemplary 
embodiment of a method according to the present invention. 

Fig. 2 shows a flowchart of an exemplary embodiment of an operation of the image 
20 processing device of Fig. 1 in accordance with the present invention. 

Fig. 3 shows a simplified schematic representation for further explaining the present invention. 

Fig. 4 shows another simplified schematic representation for further explaining the present 
25 invention. 

Fig. 1 shows an exemplary embodiment of an image processing device according to the 
present invention. The image processing device shown in Fig. 1 includes an image processing 
and control processor 1, with a memory 2, in which the measured line integrals, for example, 
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the detected sinogram and an intermediate image generated and/or updated during the 
operation may be stored. The image processing and control processor (CPU) 1 may be 
coupled, via a bus system 3, to an imaging device (not shown in Fig. 1), for example, a PET 
scanner, such as the one described in US 5,703,369, which is hereby incorporated by 
5 reference. An image generated by the image processing and control processor 1 may be 
displayed to an operator on a monitor 4, connected to the image processing and control 
processor 1. The operator may access the image processing and control processor 1 via a 
keyboard 5 or other input means, which are not shown in Fig. 1, such as a mouse or a 
trackball. 

10 

Furthermore, via the bus system 3, it is also possible to connect the image processing and 
control processor 1 to, for example, a motion monitor, which monitors a motion of the object 
of interest In case, for example, a lung of a patient is imaged, the motion sensor may be an 
exhalation sensor. In case the heart is imaged, the motion sensor may be an electrocardiogram 
15 (ECG). 

Fig. 2 shows a flowchart of a method for operating the image processing device depicted in 
Fig. 1 in accordance with an exemplary embodiment of the present invention. 

20 After the start in step SI, the emission data is acquired in step S2. This may, for example, be 
done using a suitable PET scanner or by reading the emission data from a storage. The 
emission data consists of a plurality of line-integrals of the unknown tracer concentration 
relating to Ihe position and/or orientation of the line of response (LOR) on which ihe event 
was happening and the integral of the events over Ihe measurement time. Typically events with 

25 the same or almost the same LOR are added to from a so-called line integral. Furthermore, 
line integrals, which belong to parallel LORs, are grouped together. Such a group is called 
projection. The data structure containing projections from 0 to 180 degrees is usually referred 
to as sinogram. Here, in the subsequent step S3, according to an aspect of the present 
invention, events of the emission data are binned additionally into temporal bins. However, 
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according to an aspect of the present invention, the present invention may also be applied to 
spatially non-binned single events by using so-called list-mode reconstruction. 

Each temporal bin belongs to a certain motion state. In other words, in case an organ with a 
5 more or less periodical motion is imaged, the emission data is rearranged such that projections 
acquired at a similar phase or motion state are binned into the same temporal bin. The 
decision as to which temporal bin an event belongs may be made on the basis of information 
acquired by means of a motion sensor, such as, for example, an exhalation sensor or an 
electrocardiogram. According to an aspect of the present invention, it may also be possible to 
10 use intrinsic information in the emission data itself, such as the center of gravity of the events 
averaged at a few ten or hundred milliseconds as described in further detail in 'Four- 
dimensional affine registration models for respiratory-gated PET", Klein, GJ.; Reutter, R.W.; 
Huesman, R.H.; 

Nuclear Science, IEEE Transactions on , Volume: 48 Issue: 3 , Jun 2001 
15 Page(s): 756 -760, which is hereby incorporated by reference. 

A three dimensional image is reconstructed from each temporal bin using standard 
reconstruction techniques. These images may be reconstructed in a low resolution in order to 
obtain a reasonable signal-to- noise-ratio and to keep the computational cost modest. A 

20 motion field describing the motion of the image relative to a chosen reference image (which 
can be for instance the image with the highest signal- to- noise-ratio) is determined for each 
image in step S4. A motion field describes a motion and/or deformation of the object of 
interest at a certain point of time. The motion field may be determined in accordance with the 
method described in T. Schaffier, V. Rasche, LC. Carlsen, "Motion Compensated Projection 

25 Reconstruction", Magnetic Resonance in Medicine 41: 954-963 (1999), which is hereby 
incorporated by reference. 

Fig. 3 shows examples of such motion fields. The left side of Fig. 3 shows an undisturbed 
reference motion field and the motion field on the right side of Fig. 3 shows another motion 
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state where the grid of the motion field is deformed In comparison to the left side of Fig. 3, 
the grid points n in the grid on the right side of Fig. 3 are displaced by a vector ? i due to the 
motion. 

5 In other words, the grid points n of the grid of the motion fields describe the local motion or 
deformation of the object of interest 

Then, the method continues to step S5, where a first intermediate image Ao(x,y) is determined. 
The first intermediate image Ao(x,y) may, for example, be a homogenous distribution, a 
10 filtered-back projection of the emission data or a simple back-projection of the emission data. 
Then, in the next step S6, a counter is initiated with n = 0. In the subsequent steps S7 to S12, 
the motion compensated iterative image reconstruction is performed 

In step S7, the intermediate image An-a(x,y), in the case of the first iteration, the first 
15 intermediate image determined in step S5, is forward-projected by using the motion fields 
corresponding to the projection. In other words, the intermediate image Ao+n(x,y) is forward- 
projected by using motion or deformation information gathered from the motion field 
corresponding to the motion of Ihe object of interest at such point in time. 

20 Then, in the subsequent step S8, the forward projected Ao+nCx.y) is compared to a 
corresponding projection of the emission data to determine a difference between the 
projected intermediate image Ao+„(x,y) and the projection actually measured In other words, 
in step S8, a comparison is made between the motion and/or deformation compensated 
intermediate image and the projection actually measured at the time, hi a simple case, the 

25 difference may simply be deteamined on the basis of a subtraction 

Then, the method continues to step S9, where Ihe difference or error determined in step S8 is 
back-projected by using the motion field used in step S7. This may simply be done by storing 
the integration weights of the individual voxels of the intermediate image A>+«i(x,y) during the 



-8- 



PHDE030219EP-P 



forward-projection in step S7. These integration weights define how strongly the voxel 
contributed to the line integrals. The same weights can be applied after proper normalization 
during the back-projection in step S9. This results in a new (updated) intermediate image 
Ai +n (x,y) in step S9. Then, the method continues to step S10, where it is determined whether 
5 an end criterion is met or not The end criterion may, for example, be that the iteration was 
performed for all projections of the emission data or that the differences between the 
projection actually measured and the intermediate image Ao +n (x,y) are below a predetermined 
threshold In case it is determined in step S 1 0 that the end criterion is not met, the method 
continues to step Sll, where the counter n is incremented: n = n + 1. Then, the method 
10 continues to step S7, where the new intermediate image determined in step S9 is forward- 
projected. Then, steps S7 to Sll are iteratively repeated until the end criterion is met In case 
it is determined in step S10 that the end criterion is met, the method continues to step S12, 
where it ends. 

15 In other words, as described above, during iterative reconstruction, the intermediate image A 
o*n(x,y) is updated based on the information of a selected projection (or a selected line of 
response LOR). Each projection belongs to a certain motion state and the position of the grid 
points xi are displaced by a vector ? i due to the motion. Then, as indicated with reference to 
step S7, in the forward-projection, the contribution of the activity located at each grid point to 

20 the signal in the selected projection is calculated. According to the present invention, in this 
step, the true position r 4 + ? i of the grid point in the current motion state is used, thus allowing 
for a compensation of the motion. Furthermore, according to an aspect of the present 
invention, the local deformation of the gird is taken into account The local topology is critical, 
since the image value at a grid point represents the activity in the neighborhood of the grid 

25 point The distribution of the activity over the neighborhood is usually referred to as basis 

function. Basis functions are, for example, voxels or blobs. According to the present invention 
as described above, the shape of the basis function is also subjected to the local deformation 
derived from the motion field. As described with reference to Fig. 2, this is made by using the 
respective motion field, corresponding to the projection in the forward-projection in step S7 
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and the back-projection in step S9. In a first approximation, a rotation, a sheering and/or a 
stretching or compression may describe such local deformation. After deformation, the blob 
may be renormalized, in order to ensure that the normal activity represented by the image is 
invariant 

5 

As mentioned above, Fig. 3 shows two motion fields: on the left side, a first motion field, 
including a rectangular, not deformed grid belonging to the reference temporal bin; on the right 
side of Fig. 3 there is depicted a second deformed grid, where the grid points are displaced 
by vectors ? i. The motion field on the left side of Fig. 3 is Hie motion field of reference image 

10 AH a (x,y). The motion field on the right side of Fig. 3 describes the motion and/or deformation 
of the object of interest at a time point ti in comparison to the reference grid or reference 
motion field shown on flie left side of Fig. 3. As mentioned above, as the basis function for 
describing an activity in the neighborhood of the grid points r i5 a blob may be used. On the left 
side of Fig. 3, an undisturbed blob at a grid point r t at Ihe reference grid is shown. The right 

15 side of Fig. 3 shows the displacement and distortion of the same blob after taking the motion 
and the distortion of the object of interest into account As may be taken from the right side of 
Fig. 3, in comparison to the left side of Fig. 3, from a circular form on the left side, the blob 
has been distorted to an egg-like shape on the right side of Fig. 3. Furthermore, the position of 
the blob has moved to the right side and the breadth of the blob has increased. 

20 

The left side of Fig. 4 shows a 3D view of a 2D standard blob. The right side of Fig. 4 shows 
the view of the blob if the local deformation was a compression by a factor of 1.5 in one 
direction. 

25 Thus, according to an aspect of the present invention, the reference image Ao+„(x,y) is 

forward-projected by using the motion field such that it is projected, motion and deformation 
corrected, onto the respectively measured projection of the emission data. Thus, by also 
taking this motion and deformation information into account by back-projecting the correction 
factors for Ihe intermediate image, each basis function, ie. voxel or blob of the intermediate 



-10- 



PHDE030219EP-P 



image is only updated with the immediately and directly corresponding information from the 
respective projection of the emission data by which a blurring or smearing effect in the final 
image can be avoided and a sharp PET image can be provided. 

5 According to an aspect of the present invention, all data are used in a single reconstruction 
process in order to maximize the common likelihood function of the image. Furthermore, as 
apparent to the skilled person, the above described technique may be applied to all known 
iterative reconstruction techniques known in PET, SPECT or CT imaging, such as, for 
example, RAMLA, ME- ML, OS-M&ML, or ART. 

10 
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CLAIMS 



1. Method of reconstructing an image from measured line-integrals of an object, the method 
comprising the steps of: 

binning of the measured line-integrals into a plurality of temporal bins; 
detemiining a plurality of motion fields for the plurality of temporal bins; 
5 selecting first data from a selected bin of the plurality of temporal bins; 

forward-projecting an intermediate image for forming second data by using a motion 
field of the plurality of motion fields that belongs to the selected temporal bin; 
detemiining a difference between the first data and the second data; 
up-dating the intermediate image on the basis of the difference, 

10 

2. Method according to claim 1 , wherein the intermediate image is up - dated on the basis of a 
back-projection performed by using the motion field that belongs to the selected temporal bin. 

3. Method according to claim 1, wherein the plurality of motion fields contains information 
15 with respect to a location shift and a local deformation of basis functions of the intermediate 

image with regard to the measured line-integrals. 

4. Method according to claim 1, wherein the steps of claim 1 are iteratively performed until an 
end criterion has been fulfilled 

20 
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5. Method according to claim 1, wherein the plurality of motion fields describes at least one of 
a motion and deformation of the object with respect to a reference grid of the intermediate 
image. 

6. ethod according to claim 1, wherein the plurahty of motion fields is detemiined from a set 
of images where each image is reconstructed using data from one temporal bin of the plurality 
of temporal bins only; 

7. linage processing device for reconstructing an image from measured line-integrals, 
comprising: 

a storage for storing the positron emission data; and 

an image processor for reconstructing the image from the measured line-integrals; 
wherein the image processor is adapted to perform the following operation: 
binning of the measured line-integrals into a plurality of temporal bins; 
determining a plurality of motion fields for the plurality of temporal bins; 
selecting first data from a selected bin of the plurality of temporal bins; 
forward-projecting an intermediate image for farming second data by using a motion 
field of the plurality of motion fields that belongs to the selected temporal bin; 

detemining a difference between the first data and the second data; and 
up-dating the intermediate image on the basis of the difference. 
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8. Positron emission tomography system, wherein the positron emission tomography system 
includes a storage for storing measured line-integrals and an image processor, wherein the 
image processor is arranged to perform the following operation: 

binning of the measured line- integrals into a plurality of temporal bins; 
5 dete rmining a plurality of motion fields for the plurality of temporal bins; 

selecting first data from a selected bin of the plurality of temporal bins; 

forward-projecting an intermediate image for forming second data by using a motion 
field of the plurality of motion fields that belongs to the selected temporal bin; 

dete rminin g a difference between the first data and the second data; 
10 up-dating the intermediate image on the basis of the difference. 

9. Computer program product comprising computer program means to cause a processor to 
execute the following steps when the computer program means are executed on the 
processor: 

15 binning of the measured line-integrals into a plurality of temporal bins; 

detemiining a plurality of motion fields for the plurality of temporal bins; 

selecting first data from a selected bin of the plurality of temporal bins; 

forward-projecting an intermediate image for forming second data by using a motion 
field of the plurality of motion fields that belongs to the selected temporal bin; 
20 determining a difference between the first data and the second data; 

up-dating the intermediate image on the basis of the difference. 



25 
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ABSTRACT 

Motion compensated reconstruction technique 

The long scan time in PET imaging may lead to a significant loss of resolution, due to patient or 
organ motion. According to the present invention, the distortion or motion may be 
5 compensated by performing a forward- projection, and/or back-projection of the intermediate 
image on the basis of a motion field describing a motion and/or distortion of the object of 
interest 

(Fig. 2) 
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acquiring emission data 
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binning the emission data into temporal bins S3 



determining motion fields for each of the temporal bins 
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determining the first intermediate image Ao(x,y) 
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forward-projecting Ao+. n (x,y) by using the motion field 
corresponding to the projection 
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comparing the projected Ao+ n (x,y) to a projection of the 
emission data to determine an error 
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